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We consider the problem of transmission of digital data over a discrete- 
time Gaussian channel with the use of a Gaussian feedback channel. We 
are particularly interested in the case where the signal-to-noise ratio in the 
feedback channel is finite. By making use of simple extension of P. Elias' 
scheme for transmitting analog data over this channel with feedback, we 
show that it is possible at some transmission rates to increase the error- 
exponent (reliability) compared to the error-exponent found by C. E. 
Shannon for the one-way channel. In particular at transmission rate zero, 
we show that the error-exponent can be improved by a factor of 1 + 
[p/(l + p)], where p and p are the forward and feedback signal-to-noise 
ratios respectively. 

I. INTRODUCTION 

We consider the problem of transmission of digital data over a dis- 
crete-time Gaussian channel with the use of a Gaussian feedback channel. 
We are particularly interested in the case where the signal-to-noise 
ratio in the feedback channel is finite. 

In Sections II and III we consider Elias' scheme and a simple exten- 
sion for transmitting analog data over this channel with feedback. 1 * 2 
In Section IV we apply this extended Elias scheme to the digital trans- 
mission problem. The main result is that for any rate R < R*, a number 
less than the channel capacity, it is possible to transmit digital data at 
a rate R with error probability 

P t = exp [— E*n„ + o(n )], as n — » °o, 

where n is the encoding-decoding delay, and E* > E t , the "one-way" 
exponent estimated by Shannon. 3 In particular, when R = 0, E t = p/4 
and E* = (p/4)[l + p(l + p) _1 ], where p and p are the forward and 
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feedback signal-to-noise ratios respectively. Finally, we suggest a 
modfication of this scheme which will probably permit extending R* to 
capacity. 

Stimulated by the work of Schalkwijk and Kailath, a great deal of 
research has been done on this problem (see for example Refs. 4-11). 
To the present author's knowledge, however, the result in this paper 
is the first to show that a noisy feedback channel can improve the error- 
exponent for digital communication on a band-limited channel. (Ref- 
erences 4 and 8 treat the infinite band case.) Like the optimal coding 
schemes for the one-way channel, our scheme is not constructive. Let 
us remark here that this discrete-time channel is a model for the con- 
tinuous-time Gaussian channel with a bandwidth constraint. (See Ref. 
12 or 13.) 

II. STATEMENT OF ELIAS' PROBLEM 

We define a Gaussian channel as follows. The input is a real number 
x and the output is a number y = x + z, where the "noise" 2 is a Gaussian 
variate with mean zero and variance a 2 and is independent of x. We 
assume here that the channel input x is a random variable, and require 
that the expectation Ex 2 < P, the "signal power". 

To begin with, let us suppose that we wish to transmit the value of a 
random variable 8 with the use of N transmissions over a Gaussian chan- 
nel (with parameters P and o- 2 ). Assume also that a feedback Gaussian 
channel (with parameters P and & 2 ) is available which we may use 
{N — \) times alternating with the N forward uses. We assume nothing 
about the statistical nature of 8 except that the expectation Ed 2 = a] . 
Our goal is to obtain an unbiased estimate 8 of 8 with minimum possible 
mean-squared error. Further, we restrict ourselves to linear processing 
of all data. We now state the problem and constraints precisely. 

The forward and feedback channels are memoryless Gaussian channels 
with signal power P and P respectively and noise power a 2 and &* 
respectively. Thus for the nth use of the forward channel the input is 
x n and the output is y n = x n -\- z n , where Ex\ = P and z n is a Gaussian 
variate (independent of x n ) with mean zero and variance a 2 . For the 
nth use of the feedback channel the input is #„ and the output is y n = 
x n + z n , where Ex 2 n = P and z n is a Gaussian variate (independent of 
x n ) with mean zero and variance &'. We assume that the random varia- 
bles [8, z n , $„} are independent. The condition requiring "linear process- 
ing" means the following. The input x„ to the forward channel (at the 
nth use) is given by 
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n-l 

.r, = a x 6, x„ = a n d + £ M* - n » 2, 3, • • • , tf. (1) 
The input to the feedback channel x n (at the ?ith use) is given by 

x„ = 2>,,2/, , «= 1.2, ••■ ,N- 1. (2) 

A— 1 

Finally, the receiver's estimate after N uses of the forward channel 
(and N — 1 uses of the feedback channel) is 

= £ 4*. . (3) 

We require that be unbiased, that is, that given that = 0„ , the 
conditional expectation of is 

E{6 | = j = O . (4) 

The mean squarcd-error, which wc wish to minimize is 

7 2 = E(e - 0) 2 . (5) 

Let 7op T be the minimum attainable value of y 2 (over all choices of 
the coefficients a n , b nk , c, lk , d n ). It is easy to show that 

(t) 7opt depends on P and a 2 only through their ratio p = P/o- 2 
(the forward "signal-to-noise" ratio), and on P and a 2 only through 

(m) for a given iV, p, and p, 7opt 1S proportional to (r„ . 
Thus we can write 

7opt = ^optCp. P.-^V). 

and our problem reduces to the determination of eo PT (p, p, N) (which 
can be thought of as a noise-to-signal ratio). 

Let us observe that from the linearity assumptions (equation 1, 2, 
and 3) it follows that 

- 00 + £, (6) 

where a is a constant and $ is a Gaussian variate independent of 0. From 
equation (4) it follows that a . = 1 and E£ = 0, and from equation (5) 
E£ 2 = 7". Thus we can rewrite equation (6) as 

= + t, (7) 

where £ is a Gaussian variate (independent of 0) with mean zero and 
variance y*. The important point here is that the entire process may 
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be thought of as reducing the N uses of the forward channel (and the 
N — 1 uses of the feedback channel) to a single one-way Gaussian channel 
with signal-to-noise ratio (Ed 2 )/(E^) = <r 2 e /y\ 

III. ELIAS' RESULT 

Elias solved our problem for the special case N = 2, where two uses 
of the forward channel and one of the feedback channel are permitted. 1,2 
In his solution Elias admits the possibility that for the two uses of the 
forward channel, the signal-to-noise ratios are pi and p 2 respectively, 
where p x is not necessarily equal to p 2 • His result is that the smallest 
attainable mean-squared error is given by 



7b = <re 



r , , PiP2/3 I" 1 

L Pl + P2 + d + pO(i + p 2 ) + p\ 



(8) 



As discussed at the end of Section II, we can consider the entire process 
as a single one-way gaussian channel with signal-to-noise ratio v\h B . 
We now turn to our problem, and note that we can obtain a (suboptimal) 
solution by applying Elias' technique recursively. For N = 2 we can, by 
setting pi = p 2 = p in equation (8), obtain a signal-to-noise ratio 
S 2 = {2p + p 2 p/[(l + p) 2 + p]}. For N = 3 we can, by setting Pl = S 2 
and p 2 = p, obtain a signal-to-noise ratio aS 3 given by 

s a = [s 2 + p + (1 + S2) p ( l I p) + p\ . 

and for arbitrary iV we can obtain a signal-to-noise ratio S N given by the 
recurrence 

S„ = 0,-, + p + (1 + s")(l~+ p) + fi ' (9a) 

with initial condition 

5, = p. (9b) 

Although equation (9) is difficult to solve explicitly we can obtain 
an approximate solution valid for large N. From equation (9a) 

s*-. + p ^ s„ £ s N - t + p + (1 ^ p) , (10) 

so that 

P N ^ s N ^ ( P + Y+~) N - (11) 
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We will show that as N — > °° , S N is asymptotic to the right member of 
inequality (11). Let us rewrite equation (9a) 



c c _l x & [~i a. 1 + p ± A T 

6 " +1 " b » + p + (1 + p) L 1 + (1 + P )SJ 



(12) 



Let 8 N = [p + pp/(1 + p)]N + 5.v , and expand the last term in equa- 
tion (12) into a power series in (1 + p + p)/[(1 + p)S k ]. We then obtain, 
after cancelling terms, 

* * 4- pp r a + p + p) i (i + p + p)2 1 i (13^ 

*,*, - s, + (1 + p) |_- (1 + p)Sv + (1 + p)X + J m; 

From equation (11) we have that £# = 0(N), so that equation (13) 
becomes 



** + i - «jr - -0(l/N), 


(14) 


and therefore 




5„ = -0(log AT). 


(15) 


Thus we conclude that 




^- rp + 7r^V-°( lo g^)- 


(16) 



An exact solution for S N for various values of p, p, and iV is given in 
Table I. &J? provides an upper bound to eo PT . 
Elias also found a lower bound to £ 2 OPT , 

e 2 OPT ^ 1/[ P N + fi(N - 1)]. (17) 

This is the mean-squared error which results when the feedback chan- 
nel is reversed and used in the forward direction, and we are allowed 
to use the forward channel N times and the feedback channel (iV — 1) 
times. Combining these results we have that 

p + r (^)tf -O(logtf)] '• (18) 



[(p + fi)N]~ l ^ «OPT ^ 



Let us remark here that the recurrence (9) can be solved exactly for 
the special case p = °° . In this case equation (9a) becomes 

S N = ftr^(l + P ) + p, (19) 

and the solution is 

8 N = (1 + pf - 1. (20) 
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Table I — The Extended Elias Scheme 



FORWARD SNR = P , 



ASYMP. 



SNR = limjv^, ^ = p + jqr 



FEEDBACK SNR = /S 
ASYMP. E(0) = £*((>) 



FORWARD SNR =0.01 
ASYMP. SNR = 0.010099 



FEEDBACK SNR = 0.01 
ASYMP. E(0) = 2.52475E-03* 



N 


EQ. SNR = S K 


EQ. £(0) = E K (0) 


CAPACITY = c K 


1 


0.01 


0.0025 


4.97516E-03 


2 


0.020001 


2.50012E-03 


4.95089E-03 


3 


3.00029E-02 


2.50024E-03 


4.92693E-03 


4 


4.00058E-02 


2 . 50036E-03 


4.90328E-03 


5 


5.00095E-02 


2 . 50048E-03 


4.87992E-03 


6 


6.00142E-02 


2.50059E-03 


4.85686E-03 


7 


7.00197E-02 


2.50071E-03 


4.83408E-03 


8 


8.00262E-02 


2.50082E-03 


4.81158E-03 


9 


9.00334E-02 


2.50093E-03 


4.78935E-03 


10 


0.100042 


2.50104E-03 


4.76740E-03 



FORWARD SNR =0.01 
ASYMP. SNR = 1.0990 1E-02 



FEEDBACK SNR =0.1 
ASYMP. E(0) = 2.74752E-03 



A r 


EQ. SNR = S N 


EQ. E(fl) = E N (0) 


CAPACITY = e„ 


1 


0.01 


0.0025 


4.97516E-03 


2 


2.00089E-02 


2.50112E-03 


4.95284E-03 


3 


3.00266E-02 


2 . 50222E-03 


4.93078E-03 


4 


0.040053 


2.50331E-03 


4.90895E-03 


5 


5.00878E-02 


2.50439E-03 


4.88738E-03 


6 


6.01309E-02 


2.50546E-03 


4.86604E-03 


7 


7.01823E-02 


2.50651E-03 


4.84493E-03 


8 


8.02417E-02 


2.50755E-03 


4.82405E-03 


9 


9.03091E-02 


2.50859E-03 


4.80340E-03 


10 


0.100384 


2.50961E-03 


4.78297E-03 


20 


0.20154 


2.51924E-03 


4.59009E-03 


30 


0.303354 


2.52795E-03 


4.41569E-03 


40 


0.40574 


2.53587E-03 


4.25704E-03 


50 


0.508622 


2.54311E-03 


4.11197E-03 


100 


1.02871 


2.57178E-03 


3.53701E-03 


150 


1.55532 


2.59219E-03 


3.12725E-03 


200 


2.0861 


2.60762E-03 


2.81727E-03 


250 


2.61979 


2.61979E-03 


2.57283E-03 


300 


3.1556 


2.62967E-03 


2.37410E-03 


350 


3.69305 


2.63789E-03 


2.20869E-03 


400 


4.23179 


2.64487E-03 


2.06844E-03 


450 


4.77156 


2.65087E-03 


1.94771E-03 


500 


5.31219 


2.65609E-03 


1.84248E-03 



f The notation "3E-5" means 3 X 10" 
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Table I — (Continued) 



FORWARD SNR =0.01 
ASYMP. SNR = 0.019901 



FEEDBACK SNR = 1 

ASYMP. E(0) = 4.97525E-03 



N 


ICQ. SNH = N v 


EQ. EIO) = E N (Q) 


CAPACITY = < v 


1 


0.01 


0.0025 


4.97516E-03 


2 


2.00495E-02 


2 . 50619E-03 


4.96279E-03 


3 


3.014S3E-02 


2.51235E-03 


4.95045E-03 


4 


0.040296 


2.51850E-03 


4.93816E-03 


5 


5.0492f)E-02 


2.52463E-03 


4.92591E-03 


10 


0.102197 


2.55493E-03 


4.86529E-03 


15 


0.155082 


2 . 58470E-03 


4.80572E-03 


20 


0.209115 


2.61394E-03 


4.74722E-03 


40 


0.436077 


2.72548E-03 


4.52394E-03 


60 


0.678846 


2.82852E-03 


4.31755E-03 


80 


0.935508 


2.92346E-03 


4.12731E-03 


100 


1.20434 


3.01085E-03 


3.95214E-03 


300 


4.31176 


3.59313E-03 


2.78320E-03 


500 


7.79234 


3.89617E-03 


2.17388E-03 


700 


11.4295 


4.08196E-03 


1.80005E-03 


900 


15.1502 


4.20840E-03 


1.54552E-03 



FORWARD SNR = 1 
ASYMP. SNR = 1.05 



FEEDBACK SNR =0.1 
ASYMP. E(0) = 0.2625 



N 


EQ. SNR = S K 


EQ. E(0) = EjfiO) 


CAPACITY = - v 


1 


1 


0.25 


0.346574 




2 


2.02439 


0.253049 


0.276677 




3 


3.05731 


0.254776 


0.23342 




4 


4.09453 


0.255908 


0.203521 




5 


5.13433 


0.256716 


0.18139 




6 


6.17584 


0.257327 


0.164227 




7 


7.21857 


0.257806 


0.150457 




8 


8.26222 


0.258194 


0.139122 




9 


9.3065S 


0.258516 


0.129599 




10 


10.3515 


0.258788 


0.121468 





FORWARD SNR = 1 
ASYMP. SNR = 1.5 



FEEDBACK SNR = 1 
ASYMP. E(0) = 0.375 



N 


EQ. SNR = N.v 


EQ. Ei.O) = £ v (0) 


CAPACITY - e N 


1 


1 


0.25 


0.346574 


2 


2.2 


0.275 


0.290788 


3 


3.4973 


0.291441 


0.250579 


4 


4.84722 


0.302951 


0.220746 


5 


6.22905 


0.311453 


0.197811 


6 


7.63202 


0.318001 


0.179623 




9.04989 


0.32321 


0.164826 


S 


10.4788 


0.327462 


0.152531 


9 


11.9162 


0.331005 


0.142138 


10 


13.3603 


0.334007 


0.133223 
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Table I — (Continued) 



FORWARD 


SNR = 1 


FEEDBACK SNR = 100 


ASYMP. 


SNR = 51 


ASYMP. E(0) =12.75 


N 


EQ. SNR = S N 


EQ. E{0) = E K (P) 


CAPACITY = e N 


1 


1 


0.25 


0.346574 


2 


2.96154 


0.370192 


0.344158 


3 


6.70566 


0.558805 


0.340326 


4 


13.5159 


0.844743 


0.334405 


5 


24.9907 


1.24954 


0.325774 


6 


42.434 


1.76808 


0.31427 


7 


66.142 


2.36222 


0.300486 


8 


95.3736 


2.98042 


0.285515 


9 


128.952 


3.58201 


0.270398 


10 


165.782 


4.14455 


0.255834 


50 


2073.46 


10.3673 


7.63746E-02 


90 


4079.34 


11.3315 


4.61885E-02 


200 


9646.14 


12.0577 


0.022936 



FORWARD SNR = 100 


FEEDBACK SNR = 1 


ASYMP. SNR = 100.99 


ASYMP. E(0) = 25.2475 


N 


EQ. SNR = S N 


EQ. E(0) = E N (0) 


CAPACITY = c N 


1 


100 


25 


2.30756 


2 


200.98 


25.1225 


1.32704 


3 


301.965 


25.1638 


0.95227 


4 


402.952 


25.1845 


0.750162 


5 


503.94 


25.197 


0.622444 


6 


604.928 


25.2053 


0.533897 


7 


705.916 


25.2113 


0.468637 


8 


806.905 


25.2158 


0.418403 


9 


907.894 


25.2193 


0.378457 


10 


1008.88 


25.2221 


0.345879 



Since the capacity, 5 log (1 + S N ), of the equivalent Gaussian channel 
(with signal-to-noise ratio S N ), cannot exceed N times the capacity, 
$ log (1 + p), of a single channel (with signal-to-noise ratio p), S N as 
given by equation (20) is in fact optimal. Thus 

4pt(p, «>,#)« Kl + P) y - I]"*, (2D 

which is an exponential in N. 

TV. application to digital communication 

4.1 Schalkwijk-Kailath Technique 

Suppose we wish to transmit one of M equaDy likely messages over 
a Gaussian forward channel with signal-to-noise ratio p with the aid of 
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Table I — (Continued) 



FORWARD SNR = 100 
ASYMP. SNR = 199.01 



FEEDBACK SNR = 100 
ASYMP. E(0) = 49.7525 



N 


EQ. SNR = S N 


EQ. E{0) = E N (p) 


CAPACITY =c w 


1 


100 


25 


2.30756 


2 


297.078 


37.1347 


1.42434 


3 


495.429 


41.2S58 


1.03457 


4 


694.043 


43.3777 


0.817997 


5 


892.77 


44.6385 


0.679545 


6 


1091.56 


45.4816 


0.583023 


7 


1290.39 


46.0853 


0.511677 


8 


1489.25 


46.539 


0.456669 


9 


1688.12 


46.8923 


0.412887 


10 


1887.02 


47.1754 


0.377164 



FORWARD SNR = 100 
ASYMP. SNR = 1090.1 



FEEDBACK SNR = 1000 
ASYMP. E(0) = 272.525 



N 


EQ. SNR = S„ 


EQ. E(fl) = E N (P) 


CAPACITY = c N 


1 


100 


25 


2.30756 


2 


1092.78 


136.597 


1.74935 


3 


2173.1 


181.091 


1.28073 


4 


3258.25 


203 . 641 


1.01116 


5 


4345.00 


217.253 


0.837702 


10 


9786.78 


244.669 


0.459444 


15 


15232.7 


253.878 


0.321.042 


20 


20680.1 


258.501 


0.248424 


40 


42474.8 


265.467 


0.133209 


60 


64272.6 


267.803 


9.22575E-02 


80 


86071.7 


268.974 


7.10184E-02 


100 


107871. 


269.679 


5.79435E-02 


120 


129672. 


270.149 


4.90532E-02 


140 


151472. 


270.486 


4.26006E-02 


160 


173273. 


270.738 


3.76957E-02 


180 


195073. 


270.935 


3.38365E-02 


200 


216874. 


271.093 


3.07177E-02 



a Gaussian feedback channel with signal-to-noise ratio p, using the 
forward channel N times and the feedback channel N — 1 times. Fol- 
lowing Schalkwijk and Kailath, 10 we assign to message i (i = 
1, 2, • • • , M) the number B = t = i — (M + l)/2. Thus the M mes- 
sages are equally spaced on the interval [—(M — l)/2, (M — l)/2] at 
distance 1 apart. We can now apply the results of Sections III and IV 
to transmit 0. The expectation Ed 2 = a\ is 



a] = (M + \){M - 1)/12, M = 1, 2, 3 



(22) 
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When message i is transmitted, the output of the system is = t + i, 
where £ is a zero mean Gaussian random variable with variance y 2 . We 
select as the decoder output, that j(l ^ j ^ M) which minimizes 
| 6 — 6,- |, so that we make an error only when | £ | ^ \. This event has 
probability 

P. = 2»(-1/2t), (23) 

where $(x) = l/(2ir)* /!.„ exp (—x 2 /2) dx is the cumulative error 
function. Thus the smallest error probability attainable using this 
scheme (with parameters N, p, p) is 



= 2* 



_ 2c pt(p, P, N)a g 



1 ' (24) 



where cr e is given by equation (22) and e pT in Section II. The bounds 
on e OPT in Section III immediately yield bounds on P e , OPT ■ 

Let us assume that every T seconds, a digital message source emits 
one of M = e RT equally likely messages (R is the message "rate"). 
Further assume that N = aT (for example, if the "physical" channel 
has bandwidth W cps, then a = 2T'F) . Consider two cases: p = <x> , p < x . 

(i) When p = °o, it follows immediately from equation (21) and 
(22) that as T -> » 

o T i m ~ V§ (1 + ffr p)gr = V§ C (C - fl,T , (25) 

where C = (a/2) log (1 + p) is the channel capacity in nats per second. 
Thus, provided R < C, as T — » oo the argument of $ in equation (24) 
becomes infinite and P«,, pt — * 0. In fact, (since <b(x) ~ (2irx 2 )~'' exp 
(-x 2 /2), nsx^ * ) 

P., opt = exp[<f ,c '-' J,T+om ] ) as r-^oo, (26) 

a double exponential decay. This is the celebrated result of Schalkwijk 
and Kailath. 10 ' 11 

(ii) If we try to apply the same scheme when the feedback signal- 
to-noise p < oo, then from equation (18) (2€opt0"«) _1 — * as T —* oo. 
Thus it is not possible using this scheme to obtain vanishingly small 
error probability as T —> oo with fixed signal-to-noise ratios in the 
forward and feedback channel. This is so no matter how large p may 
be, provided it is finite. For finite T however, equations (18) and (24) 
yield useful estimates of attainable error probabilities. 



i 
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4.2 Improving the One-Way Error Exponent 

Suppose that, as in Section 4.1, we wish to transmit one of M = e RT 
equally likely messages in T seconds. Suppose that we use only a for- 
ward Gaussian channel (with signal-to-noise ratio p) n„ = aT times. 
Then it is well known that one can attain an error probability 



P e = exp 



-E^ , pjaT + o(T) 



as T -* oo , (27) 



where E^R/a, p) > 0, if R < a/2 log (1 + p) = C, the channel capacity- 
As indicated, the quantity Ej(R/a, p) depends on R and a only through 
their ratio. Although Ej is not known exactly, estimates are given in 
Ref. 3. f In particular, E^O, p) = p/4 and E^C/a, p) = 0. 

Now suppose we have a Gaussian feedback channel available with 
signal-to-noise ratio p. Let us divide the n forward channel uses into 
v = n„/N groups of N forward channel uses. In each of these groups we 
use the extended Elias scheme, (of Sections III and IV, with N uses of 
the forward channel and N — 1 uses of the feedback channel) to gen- 
erate an equivalent forward Gaussian channel with signal-to-noise ratio 
S N given by the recurrence (9). We then use a one-way coding scheme 
with v = nJN = (a/N)T uses of the equivalent forward channel. 
With N held fixed as T — » « , we can attain an error probability as in 
equation (27) with a replaced by (a/N) and p replaced by S x — namely, 



P, = exp 



*{ffi,*)f + <n" 



(28) 



Thus the new error-exponent is 



E X (R,P,P) =J7E l (^-,S x )- (29) 

Since N is arbitrary, we can state our result: 

Theorem: Given a forward and feedback Gaussian channels which can 
each process a inputs (independently) per second, with signal-to-noise 
ratio p and p respectively. Then it is possible to transmit digital data at a 
rate R nats per second with error probability 

p. = exp [-E*aT + o(T)], as T -* oo, (30a) 

t The conventional power constraint, for a one-way channel is that the time 
average of the square of the inputs must not exceed P. The power constraint used 
here is that the statistical expectation of the square of each input not ex- 
ceed P. Nither of these constraints imply the other. However, it is not hard to 
show that the estimates of Ei (in Ref. 3) are valid for both constraints. 
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where 

E* = E*fe , p ,p)= sup E 9 = sup ^^,(— , S N ) , (306) 

\OC I lSAT<oo lSJV<oo IS \ a I 

S N is the solution to the recurrence (9), and E t is the reliability (error- 
exponent) for the one-way Gaussian channel as in equation (27), and T 
is the encoding-decoding delay. 

Remarks: 

(i) Since S, = p and E^R/a, p) > for R < a/2 log (1 + p) = C, 
then E*(R/a, p, p) > for R < C. 
(ii) Since 2?i(0, p) = p/4, 



E N (0,P,fi) =^ 1 (^,5 Ar ) 



4iV 



so that from equation (16), 



mP.^I-^l + ^j, as 7V-» 

In fact, since S N /N can be shown to be non-decreasing, E*(0, p, p) is 
in fact equal to this quantity. Thus the use of the feedback channel 
represents an improvement of a factor of [1 + /3/(l + p)] in the error- 
exponent at zero rate. 

(Hi) We can get a rough idea of the behavior of E*(R/a, p, p) as 
follows. Let r = R/a be the rate in nats per channel use. Let us crudely 
approximate the one-way exponent E x (r, p) as r varies from to c = 
C/a (the capacity in nats per channel use) by a straight line connecting 
( r = o, E % = p/4) and (r = c, E x = 0). See Fig. 1. 
Then E 2 has r = intercept at 

tf.(P, P, P) - 2.4 - 4 + 8[(1 + p) 2 + p] > 4 ' 

and E,(r, p, jj) = at r = c 2 - (1/2) (1/2) log (1 + &). Similarly, E N 
has r = intercept at 

#*(0, p,p) " 4iV r M(Ar _ 1} - 

and Jjr(r, p, p) = at r = c N - (1/2N) log (1 + S N ). From Fig. 1, 
we see that for each value of r > 0, there is a value of N(l ^ N < <») 
which maximizes E N (r, p, p) to achieve E*(r, p, p*). Values of E N (Q, p, p) 
and Cat are tabulated for various values of p, p, and N in Table I. 
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Fig. 1 — E*(r, p, p) vs. r (an approximation). 



(iv) We see from Fig. 1, that the feedback scheme offers no improve- 
ment over the one-way scheme (that is, E N < Ei , for N > 2) for r* ^ 
r < c where r* is the solution of E 2 = E t , that is, 

iff,<2r* &) = ^(r*, p). 

However, the rate r* — » c as p — > » . 

Actually, it is probably possible to improve on our results substantially 
and in particular bring about an increase in the error-exponent for all 



r < c. Let (Nx , Ni 



N k } be a set of positive integers (not neces- 



sarily equal). Then divide the n = aT forward channel uses into v = 
n /(Ni + A^ 2 + • • • N k ) uses of an equivalent channel which is the 
parallel combination of k Gaussian channels with signal-to-noise ratios 
Si*, , Sn, } ' • " i £a-i, • These k Gaussian channels are generated by 
Ni , N 2 , • • • , N k iterations, respectively, of the Elias scheme. One 
must then compute the error-exponent for a parallel combination of 
channels to obtain a new improved exponent. 14 We leave this task as an 
open problem. 

(v) Let us finally remark that although the expectation of the channel 
input power x 2 is constrained, the quantity x 2 is in fact a random vari- 
able distributed on the interval [0, °° ) . This is in contrast to the one-way 
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schemes where the channel input is bounded. This point is discussed 
in Ref. 13. 
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